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FINDING  EVERETT'S  LAGRANGE  MULTIPLIERS 
BY  LINEAR  PROGRAMMING 

R.  Brooks  & 

* 

A.  Geoffrion 

The  RAND  Corporation,  Santa  Monica,  California 

In  an  article  [4]  in  this  journal  in  1963,  Everett  observed  that 
if  x°  is  optimal  in 

m 

(1)  Maximize  f(x)  -  ^  u  g  (x) , 

r  i=l  ^ 

X  e  X 

where  the  m  constants  are  non-negative  "multipliers"  and  f  and  the 
g^  are  arbitrary  real-valued  functions  defined  over  an  arbitrary  set 
X,  then  x°  also  maximizes  f(x)  over  all  x  e  X  satisfying  gj^(x)  S  g^(x°) 
(i»l,  ...,  m).— ^  Thus  to  solve 

(2)  Maximize  f(x)  subject  to  gj^(x)  ^  b^,  i**!,  ...,  m, 

X  e  X 

where  the  b^  are  given  constants  (it  is  convenient  to  ttiink  of  the  b^^ 
as  the  amounts  of  available  resources)  it  is  sufficient  to  find  non¬ 
negative  multipliers  u°  such  that  --  and  this  we  call  Everett* s 
Condition  --  a  corresponding  optimal  solution  x°  of  (1)  can  be  found 
★ 

Any  views  expressed  in  this  paper  are  those  of  the  authors.  They 
should  not  be  interpreted  as  reflecting  the  views  of  The  RAND  Corpora¬ 
tion  or  the  official  opinion  or  policy  of  any  of  its  governmental  or 
private  research  sponsors.  Papers  are  reproduced  by  The  RAND  Corpora¬ 
tion  as  a  courtesy  to  members  of  its  staff. 

This  paper  was  prepared  for  submission  to  Operations  Research 
as  a  Letter  to  the  Editor. 

~^This  observation  is  Everett's  "Main  Theorem"  [4,  p.  401]. 
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that  satisfies  gj^(x°)  ■  b^(l*l,  m).  If  such  multipliers  exist 

and  a  convenient  mechanism  for  finding  them  Is  available,  then  solv¬ 
ing  (2)  by  solving  (1)  may  be  computationally  convenient.  For  many 
problems  of  practical  Interest,  however,  such  multipliers  do  not  exist; 
but  there  may  still  be  multipliers  for  which  the  gj^(x^)  approximate 
the  b^  closely  enough  for  x°  to  be  a  useful  approximate  solution  to 
(2).  This  approach  amounts  to  reducing  (2)  to  a  problem  without  the 
g^  constraints. 

The  step  (1^2)  of  the  Iterative  procedure  implicitly  suggested 
by  Everett  for  finding  an  (approximate)  solution  to  (2)  Is  (here  u  = 
(^1*  •••»  \)): 

(k.l)  Based  on  knowledge  of  u^,  x^,  ...,  u*^  x^”^, 

Ic 

choose  multipliers  u^  i  0  (i“l,  ...,  m)  in  an 

attempt  to  satisfy  Everett's  Condition. 

k  k 

(k.2)  Solve  (I)  with  u  >■  u  for  an  optimal  solution  x  . 

(k.3)  If  g^(x^)  is  "sufficiently  near"  b^^,  i»l, 

k 

m,  then  stop;  x  Is  sufficiently  near  to 

being  optimal  in  (2).  Otherwise,  go  to  step  k+1. 

Step  1  Is  the  same  as  the  general  step,  except  that  It  begins  with  an 

arbitrary  u^  (guessed  on  the  basis  of  past  experience  with  a  similar 

problem,  say).  It  is  assumed  that  some  method  Is  available  for  per- 

21 

forming  substep  (k.2).—  How  to  perform  substep  (k.l)  when  m  Sj  2  was 
— 

—  Throughout  this  paper  we  assume,  as  Everett  did  implicitly  In 
his,  that  (1)  achieves  Its  maximum  for  any  set  of  non-negative  multi¬ 
pliers.  A  sufficient  condition  for  this  when  X  C  r”  is  that  X  be 
closed  and  bounded  and  f  and  the  g^  be  continuous.  Similar  sufficient 
conditions  exist  for  more  general  spaces  (e.g.,  [2,  p.  69]).  See  also 
footnote  4. 
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left  largely  unresolved  by  Everett,  and  stimulated  the  present  note.— 

The  main  purpose  of  this  note  is  to  Indicate  how  one  might  approxi« 
mate  the  desired  multipliers  by  means  of  llnecir  programming.  First, 
however,  we  weaken  Everett's  Condition  slightly  so  that  his  approach 
can  be  applicable  to  problems  with  Ineffectual  constraints.  A  rela¬ 
tion  then  becomes  apparent  to  the  saddle -point  condition  of  Kuhn  and 
Tucker  [8]  for  nonlinear  programming.  Since  Everett's  approach  seems 
most  competitive  with  other  known  methods  for  certain  discrete  alloca¬ 
tion  problems,  we  consider  this  case  in  some  detail.  It  will  be  seen 
that  Everett's  method,  when  the  multipliers  are  found  by  linear  pro¬ 
gramming,  becomes  essentially  the  Simplex  method  with  a  "column¬ 
generating"  feature  applied  to  an  approximation  of  (2).  Finally,  we 
point  out  a  relation  to  the  so-called  decomposition  method  of  concave 
programming  [3,  lO]  for  contlmous  allocation  problems. 

Weakening  Everett's  Condition 

In  certain  problems  with  ineffectual  constraints,  Everett's 
Condition  is  unnecessarily  restrictive  in  that,  when  a  multiplier  is 
zero,  it  is  not  necessary  to  require  that  the  corresponding  constraint 
be  satisfied  with  strict  equality.  All  that  is  needed  is  to  find  x° 
and  u°  such  that 

(i)  x°  is  optimal  in  (1)  with  u  ■  u°  and 

(ii)  u°  ^  0  and  u°  >  0  (resp.  ■  0)  implies 
gj^(x°)  -  (resp.  S  b^^) ,  i-1,  ...,  m. 

It  is  easily  shown  that  if  these  conditions  are  satisfied,  then  is 
optimal  in  (2).  We  shall  henceforth  deal  with  this  slightly  modified 
version  of  Everett's  approach. 

— ^We  would  like  to  thank  David  McGarvey  for  encouraging  our  interest 
in  this  question. 


It  is  of  Interest  to  note  that  (1)  and  (11)  are  equivalent  to 
the  requirement  that  (x°,  a°)  be  a  saddle-point  of  the  Lagranglan 

L(x,  u)  s  f(x)  -  £  u  (g  (x)  -  b  ),  l.e., 

1-1  ^  ^ 

L(x,  u°)  £  L('x°,  u°)  ^  L(x°,  u)  for  all  xeX  and  ifeO. 

Thus  Everett's  approach  Is  seen  to  be  essentially  the  attempt  to  con¬ 
struct  a  saddle-point  for  L(x,  u) .  Kuhn  and  Tucker  [8]  and  others 
have  given  conditions  on  (2)  which  guarantee  the  existence  of  such  a 
saddle-point.  The  basic  condition  for  Euclidean  spaces  Is  that  X  be 
a  convex  set,  f  a  concave  function,  and  the  g^  convex  functions  which 
satisfy  any  one  of  a  number  of  mild  qualifications  [l].  Similar  con¬ 
ditions  for  more  general  spaces  are  known  (see,  e.g.,  [7]).  Un¬ 
fortunately,  such  conditions  do  not  cover  the  case  In  which  X  Is 
discrete,  the  situation  of  greatest  Interest  to  Everett  and  perhaps 
the  one  In  which  his  (modified)  approach  Is  most  promising. 

Finding  the  Multipliers  by  Linear  Programming 

When  (2)  is  a  linear  programming  problem,  l.e.,  when  X  Is  the 
non-negative  orthant  of  and  f  and  the  g^  are  linear  functions,  then 
it  is  not  difficult  to  show  that  (x°,  u°)  satisfies  conditions  (1) 
and  (11)  above  if  and  only  if  x°  solves  (2)  and  u°  solves  the  dual  of 
(2).  The  u°  are  often  Interpreted  as  the  "dixal  prices"  associated 
with  (2) ,  and  are  produced  as  an  automatic  by-product  of  the  computa¬ 
tional  solution  of  (2).  Dropping  the  assumption  of  linearity  now, 
and  observing  that  the  burden  of  substep  (k.l)  is  to  approximate  such 
prices  on  the  basis  of  the  data  u^,  x^,  ...,  u^  x^  it  seems 
natural  to  use  linear  programming  to  compute  the  prices  corresponding 
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to  a  linearized  version  of  (2)  over  the  convex  hull  of  the  grid 
1  k-1 

<x  ,  . . . ;  X  >.  The  resulting  linear  program,  the  dual  prices  of 
which  are  required  at  substep  (k.l),  Is: 

k-1  k-1 

(3)  Maximize  S  X  f(x  )  subject  to  £  1 

t 

2  X  g  (x  )  i  b  ,  i-1 . m. 

t-1  ^  ^ 

Substep  (k.l  LP);  Solve  (3)  for  the  dual  prices 
Ic  k  Ic 

Uq,  Uj^,  u^  corresponding  to  the  mfl  constraints. 

k 

By  linear  programming  theory,  u^  i  0  (i“i,  m).  The  signifi- 

cance  of  u^  will  become  apparent  below. 

Discrete  Case 

If  X  ■  {§j^,  ...,  §j^},  where  N  is  a  finite  positive  Integer,  then 
Everett's  procedure  using  (k.l  LP)  is  very  close  to  the  Simplex 
method  for  the  linear  programming  problem 

N  N 

(^‘)  Maximize  £  X^  ^(5j)  subject  to  £  X^  ■  1 


*  '’l' 


The  sub-problem  (1) ,  which  now  takes  the  fcrm 


Maximize 


•  •  •  f  5jj3 


f(5)  -  2  uj  g^(5). 


does  nothing  more  than  determine  (by  the  usual  Simplex  criterion) 
which  new  variable  to  bring  into  the  basis  at  the  k^^  iteration.—^ 


~  In  practice  one  probably  would  not  solve  (5)  completely  at 
every  step,  particularly  in  the  early  steps  or  when  N  is  very  large; 
from  the  theory  of  the  Simplex  method  it  is  known  that  it  is  enough 
to  find  a  |j  that  gives  a  value  greater  than  u^  to  the  maxlmand. 
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Thls  permits  the  economy  of  carrying  explicitly  at  one  time  no  more 
than  irrf-1  of  the  N  columns  corresponding  to  the  The  usual  Simplex 

termination  signal  occurs  at  the  first  step  such  that 

(6)  Maximize  [f(5)  -  E  u^  g^CC)]  ^ 

•  •  • »  5jj} 

Ic 

(actually  the  maximum  will  ■  u^).  Thus  In  the  finite  discrete  case 
Everett's  procedure  becomes  precisely  the  Simplex  method  applied  to 
(4)  with  a  "column-generation"  feature  If  substep  (k.3)  Is  replaced 
by 


Substep  (k.3  LP);  If  (6)  holds,  stop. 

Otherwise,  go  to  step  k  +  1. 

Since  (4)  Is  a  finite  linear  program,  Everett's  procedure  with  sub¬ 


steps  (k.l  LF)  and  (k.3  LP)  Is  finitely  convergent  to  the  optimal 
* 

solution  X^,  j»l,  N,  of  (4). 

This  method  has  been  used  to  advantage  by  Gilmore  and  Gomory 
[6].  In  their  problem  a  was  a  cutting  pattern,  and  the  subproblem 
a  knapsack  problem. 


The  question  arises  regarding  the  relation  of  the  optimal  solu¬ 
tion  of  (4)  to  the  original  problem  (2).  Harking  back  to  Everett's 
discussion  of  his  method  In  terms  of  "payoff -constraint  space,"  we 
see  that  if  the  points  (f(§j),  g^(5j)»  ....  ....  N) 

are  sufficiently  dense  near  the  boundary  of  their  convex  hull,  then 
some  of  the  policies  corresponding  to  X^  >  0  (and  there  will  be  no 
more  than  m*.-!  of  these)  will  be  good  approximate  solutions  to  (2). 


Note  that  It  Is  not  necessary  to  store  all  of  the  correspond¬ 
ing  to  the  basic  X^  as  the  calculations  proceed,  but  only  the  correspond* 
Ing,  f(§j)  gj^(5j).  i"l . After  termination,  the  "basic" 


can  be  recovered  If  desired  by  utilizing  the  fact  that  they  "price 

* 

out"  to  0.  That  is,  they  achieve  the  maximum  u^  =  u^  in  (6),  In 
fact  all  of  the  that  achieve  u^  in  (6)  are  "used"  by  some  optimal 

solutlo''  of  (4).  If  it  is  desired  to  examine  (7.j)  for  the  used 
in  near-optimal  solutions  of  (4),  then  one  should  recover  the 
that  satisfy 

(8)  ff; .)  -  U*  gj(5j)  »  U*  -  e 

for  some  suitably  small  e  >  0. 

A  possibly  useful  interpretation  of  (4)  is  the  following:  it 
is  the  extension  of  (2)  from  pure  to  mixed  (randomized)  strategies 
with  f  and  the  g^  replaced  by  their  expectations.  In  this  interprets- 

•fg 

tion,  Xj  is  the  probability  of  utilizing  allocation  When  mixed 
strategies  have  a  legitimate  and  acceptable  interpretation,  then  (2) 
should  have  been  written  as  (4)  in  the  first  place.— ^ 

Continuous  Case 

If  X  is  not  a  finite  discrete  set,  then  the  analysis  of  the  pre¬ 
vious  case  is  complicated  by  the  fact  that  there  are  an  infinite 
number  of  variables  in  (4).  Nevertheless,  Everett's  procedure  using 
subatep  (k.l  LP)  is  almost  exactly  the  so-called  decomposition  pro¬ 
cedure  lor  nonlinear  programming  [3,  10].  When  X  is  a  bounded  convex  set 

and  f  is  concave  and  the  g.  are  convex  functions,  then  the  sequence 
k-1  t 

<  E  X  X  >  converges  [3,  9]  to  an  optimal  solution  of  (2)  as  k  -•  *. 
t-1  ^ 


—  Cf .  Fromovitz  [S],  and  Gilmore  and  Gomory  [6]. 
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